Dataproc Lead, Spark, OSS Technologies, Google Cloud

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another.

• Build high-impact customer-facing features which make Cloud Dataproc the best place to run Spark, Ray, Trino, Flink and newer technologies in the cloud.
• Define the roadmap for Open Source technologies like Spark, Ray, Trino, Flink, etc.
• Define and implement the next generation Data Lakes and Lake Houses focusing on technologies like Iceberg, Hudi and Delta.
• Optimize the open source technologies for performance and efficiency.
• Design and build software stack to take advantage of Google technologies for faster cluster setup, efficient cluster operations, comprehensive monitoring and observability.

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
• Experience in software development and engineering, incorporating design methodologies, leveraging open source technologies, and working with distributed computing systems, including Apache Spark, Apache Hadoop, and Apache Hive.
• Experience in Open Source technologies, Big Data, Data Analytics, Artificial Intelligence, Machine Learning, and Database Internals.

• 401k matching
• Health insurance
• Flight privileges
• Stock options
• Paid time off
• Retirement plan

Google Cloud accelerates every organization’s ability to digitally transform its business and industry.